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Abstract 

Spike correlations between neurons are ubiquitous in the cortex, 
but their role is at present not understood. Here we describe the firing 
response of a leaky integrate-and-fire neuron (LIF) when it receives 
a temporarily correlated input generated by presynaptic correlated 
neuronal populations. Input correlations are characterized in terms of 
the firing rates, Fano factors, correlation coefficients and correlation 
timescale of the neurons driving the target neuron. We show that 
the sum of the presynaptic spike trains cannot be well described by 
a Poisson process. In fact, the total input current has a non triv- 
ial two-point correlation function described by two main parameters: 
the correlation timescale (how precise the input correlations are in 
time), and the correlation magnitude (how strong they are). There- 
fore, the total current generated by the input spike trains is not well 
described by a white noise Gaussian process. Instead, we model the 
total current as a colored Gaussian process with the same mean and 
two-point correlation function, leading to the formulation of the prob- 
lem in terms of a Fokker-Planck equation. Solutions of the output 
firing rate are found in the limit of short and long correlation time 
scales. The solutions described here expand and improve our previous 
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results (iMoreno et all l2002l ^ by presenting new analytical expressions 
for the output firing rate for general IF neurons, extending the valid- 
ity of the results for arbitrarily large correlation magnitude, and by 
describing the differential effect of correlations on the mean driven or 
noise dominated firing regimes. Also the details of this novel formal- 
ism are given here for the first time. We employ numerical simulations 
to confirm the analytical solutions and to study the firing response to 
sudden changes in the input correlations. We expect this formalism to 
be useful for the study of correlations in neuronal networks and their 
role in neural processing and information transmission. 



1 Introduction 



A major problem in neuroscience is to understand the way neurons commu- 
nicate with each other. Be cause neuron s in the cortex are densely con nected 
and share common inputs (IWhitd . Il989l : iBraitenberg and Schiizl . Il99lh . some 
degree of correlation between their discharges is unavoidable. Indeed, corre- 
lations in th e spiking activity of neurons are routinely obs e rved t hroughout 



1998 



the cortex fdZoharv et al 



Usrev and Reidl. 



1999 



1994; de Charms and Merzenich. 1996: Lee et al 



Bair et al.l . l200ll ): for a review see lSalinas and Sejnowski 



toOlh : lAverbeck and Leel f|2nn4l )). Correlations could have an important 
functional role, as the temporal synchronization of neuronal act ivity has been 



shown to correlate with particular states of behaving anirnals flVaadia et al 



1995 



Riehle et al.. 1997 



Fries et al.l . Il997l : ISteinmetz eraP . I2OOOI : iFries et al 



2OOII ). From a more traditional point of view, correlatio ns have been consid- 



ered as a coding dimension independent of the firing rate (IdeCharms and Merzenich 



19961 : IWehr and Laurentl . Il999l : iLaurentl . 120011 ) . However it remains still con 



troversial whether correlated activity has a role in coding, or whether its 
main rol e is as a gating mechanism of the flow of informatio n in cortical 
circuits ( ISalinas and Sejnowski I2OOII : lAverbeck and Led . 1200J). 

Before the functional role of correlations can be addressed, a prime ques- 
tion to solve is how correlations affect the flring properties of neurons. Pre- 
vious work in this direction has revealed that ne urons can be very sen- 
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sitive even to w e ak correlations in their inputs (jBurkitt and ClarkI 
Feng and Brown . 2000l : Salinas and Sejnowski . 2000l ). However, in most of 
these studies, only zero time lag correlated inputs [perfect synchronization) 
has been used. This means that when one spike arrives at one presynaptic 
terminal, another spike is more likely to be found at the same time in other 
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presynaptic terminal. This perfect synchrony is not expected to be exhibited 
by real neuronal systems, given their finite temporal precision. Instead, syn- 
chrony with a non zero time precision Tc seems to be the realistic case, with 
Tr. ~ 15ms in monkey primary auditory cortex (jdeCharnis and Merzenich . 
1996 ). Tc ~ 5ms in primary visual cortex of strabismic cats ( Fries et al. . 19971 ) 



(in this case the cross-correlogram is accompanied by an oscillatory pattern), 
Tc with very broad values ranging from less than 15ms to mor e than 2Q0ms 
medi ating interactions between areas VI and V2 in monkeys (Nowak et al.l . 



19991 ). or Tc ~ 10ms in the monkey visual area MT (IBair et al.l . l200ll ). In 



this case, if a spike arrives at time t = at a presynaptic terminal, another 
spike is more, or less, likely than the chance level determined by the firing 
rate, to arrive within a time around t = at othe r (or the same) terminal. 

We have shown previously ( Moreno et al. . 20021 ) that the total current to 
a neuron generated by exponentially correlated afferent spike trains can be 
described (among other parameters) by the correlation time, Tc, and the cor- 
relation magnitude, a (see definitions in Section ([3])). Each parameter carries 
important information about the characteristics of the input correlations (ei- 
ther temporal or intensity information). Intuitively, a short correlation time 
Tc means that afferent spikes synchronize within short time windows of size 
Tc. Decreasing will enhance the temporal precision of correlations. The 
correlation magnitude, a, roughly represents how many spikes are expected 
above chance in a time window Tc given that there was a spike centered in 
that time window. Therefore, it is a measure of the intensity of the corre- 
lations. For uncorrelated spike trains a = 0, while for positively correlated 
spike trains a > 0, and for negatively correlated a < 0. As we will show, the 
correlation time and magnitude can also be related to the autocorrelograms 
(ACGs) and cross-correlograms (CCGs) of recorded spike trains. The cor- 
relation time measures the typical width of the CCG, while the correlation 
magnitude is proportional to the area under the CCG curve. 

Both Tc and a can affect the neuron's firing response in co mplicated ways . 



Sepa rating their effects was crucial in our previous work (IMoreno et al. 



20021 ). where the effects of changing the timescale and the magnitude of 



the input correlations could be studied independently. In particular, one of 
the main qualitative results was that, if a is kept constant, neurons are sen- 
sitive to input correlations only when the correlation time is shorter than the 
membrane time constant. 0. 



This mechanism is consistent with coincidence detection (|Abelesl . 119821: 
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The main problem studied in this paper is schematized in Fig.([T]) and 
can be summarized as follows: What is the effect of the magnitude and the 
timescale of the input spike correlations on the neuron firing response? We 
answer this question by addressing consecutively several subproblems. First, 
after presenting the model (Sec [2]), we describe the statistical properties of 
the afferent spike trains which drive a LIE neuron (Sec[3l). The spike trains 
are characterized in terms of their firing rates, Fano factors, correlation coef- 
ficients and correlation timescale, and are assumed to have exponential auto- 
and cross-correlations. Correlated and uncorrelated Poisson spike trains are 
just special cases of these. The total current generated by the sum of the 
spike trains is described up to second order statistics (the two-point corre- 
lation function), and shows exponential correlations (Sec 13. 2p . Second, to 
solve the difficulties presented by the non-Markovian character of the input 
statistics, we seek to transform this input into a colored Gaussian input with 
the same mean and two-point correlation function as those generated by the 
original current. Two different Markovian stochastic processes that generate 
this colored Gaussian input are found (SecS]). Then, we obtain the Fokker- 
Plank equations (FPEs) associated to each of these two processes and the 
voltage of the neuron (Sees 14.11 and 14. 2p . Third, the output firing rate is 
obtained by solving the FPEs in the limits of short and long values of the 
correlation timescale compared to the membrane time constant of the neuron 
(SecE]). At this point we give a brief summary of the analytical expressions 
and their ranges of validity (Sec E] and Table [T]). An interpolation is then 
employed to join the two limits, and the analytical results are compared with 
numerical simulations (Sec 17. II) . Finally, we also show that neurons can track 
fast changes in input correlations (Sec 17.21) . In the discussion section (Sec 
[H]) we summarize the main results and discuss possible applications. Several 
computational details are provided in a set of appendices. 

Some of th e se res ults have been previously published in a brief format 



( iMoreno et al.l . |2002| ). In the current work we extend the analytical tech- 
niques, obtain new results and present a more pedagogical version of our 
work to facilitate the use of the mathematical expressions as well as the un- 
derstanding of their derivation. In particular, a more general expression for 
the output firing rate is found in the presence of exponentially correlated 



Bernander et al.l . Il99ll: ISoftkv and Kochl . Il993t ISoftkvl . [l99l . Note, however, that these 



authors consider input spike coincidence detection in the sub-miUisecond range, while our 
results more generally concern the effect of correlation timescale of any size on a neuron 
with any membrane time constant 



4 



input spike trains that is valid for long Tc and for all positive a (Sec 5.2). 
If the limit of s mall o; is taken, this new expression becomes that found in 
(IMoreno et al.l . |2002| ) in the case of long Tc, and therefore generalizes and 
extends the latter for large correlation magnitudes. The effect of input cor- 
relations in the mean driven and noise dominated input regimes is found to 
be different, and those peculiarities are discussed here (Sec 17. ip . 



2 Model 

We consider a LIF neuron with membrane potential Vif) and membrane time 
constant r^. In the absence of input, the voltage decays exponentially toward 
the resting potential (here = 0). In the presence of synaptic current, J(t), 
the membrane potential evolves according to the equation 

v{t) = + m . (1) 

In the model, a spike is generated whenever the membrane potential V{t) 
reaches a threshold value B. Following the spike, the potential is reset to a 
value H, from where, after an absolute refractory period r^e/, the neuron can 
start integrating the synaptic current again. 

We work in the limit of infinitely fast synaptic time constants, in which 
individual synaptic currents are represented by delta functions. Thus, the 
afferent current I{t) is 

Ne Ni 

m = JE T.T.^it-t'i)-Ji EE^(^-4)' (2) 

1=1 k j=l I 

where tj^^^jj represents the arrival time of the k-th (l-th.) spike from the i-th ex- 
citatory (j-th inhibitory) presynaptic neuron, and Ne(i) and Je{i) represent, 
respectively, the number of inputs and the size of the postsynaptic potentials 
from the excitatory (inhibitory) afferent populations. 

We are interested in the case of stationary input statistics, so that the 
input firing rates do not depend on time (but see our simulation results for 
the case on non-stationary statistics in Sec. 17.21) . Therefore, assuming that 
the excitatory and inhibitory presynaptic neurons fire at rates and 
respectively, the mean current {I{t)) is computed as 
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/i = (/(t)) = Ne Je ve - Ni Jj vi 



(3) 



This result is independent of the statistics of the afferent spike trains. For 
example, the mean current generated by correlated or independent Poisson 
spike trains is exactly the same, provided that the processes are stationary 
and described by the same firing rates. However, the second-order statistics 
of the current will be very sensitive to the second order statistical proper- 
ties of the individual spike trains (e.g., their pair- wise correlations). In the 
next section we determine the two-point correlation function in terms of the 
statistical properties of the presynaptic spike trains. 



Second-order statistical properties of the 
current 



3.1 Auto-correlograms 

This section is devoted to the description of the second order statistical prop- 
erties of each individual spike train impinging on the LIF neuron. In the 
next section, we will consider the second order statistical properties of pairs 
of those spike trains. Here, we first define the Fano factor of the spike count 
of each input train. Then we introduce the auto-correlation function in the 
case of an exponentially correlated spike train. Finally, we show that the pa- 
rameters defining the exponential auto-correlation function can be expressed 
in terms of the firing rate, Fano factor and correlation time of the spike train. 



(121)) as stochastic Poisson processes (see e.g. ( 


Ricciardi. 


1977; 


Tuckwell . 


1988; 


Brunei and Serei. 


19981: iFene and Brown. 


2000; 


NvkamD and Tranchina 


2001 


LaCamera et al.. 2004; .Richardson and Gerstnei. 2005)1. In this work, we re- 



lax this assumption. The Fano Factor is often used to quantify the reliability 
of neuronal discharge. The Fano factor of the spike count in a time window 
T is defined as the ratio between the variance of the spike count and the 
mean number of spikes in that time window, that is. 



a 



N 



(T) ((iV(T) - {N{T))f) 



(4) 



(iv(r)) (iv(T)) 

where N{T) is the number of spikes counted in the time window T in each 
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trial and brackets denote an average over trials. Note that, in practice, the 
mean and variance can also be computed using a single long spike train (with 
stationary firing rate) obtained in a single trial, where now the average is 
obtained using non-overlapping consecutive time windows instead of several 
trials. In either case, typically the time window T is taken to be large, so 
that at least tens of spikes are observed on average. A Poisson spike train 
has a Fano factor equal to one. However, Fano factors calculated from spike 
trains obtained from electrophysiological recordings in vivo usually exceed 
one, laying i n the interval Fm ~ 1 — 1.5 throughout the cerebral cortex 
(|Deanl. Il98ll: ISoftkv and Kochl . Il993l : lAlbrightl . Il993l : IShadlen and Newsomd . 



19981 : ICompte et al.l. 1200311. whi c h is in consistent with the Poisson hypothesis 



(see also ( Amarasingham et al. . 20061 )). 

Another important second-order statistical property of individual spike 
trains is the joint probability density of having spikes belonging to that same 
spike train at two times, t and t', denoted P{t,t'). In fact, from it one can 
derive any other second-order statistical quantity, such as the Fano factor 
(see below). For a Poisson spike train with rate z/, P{t, t') is a delta function 
at zero-time lag and flat otherwise, as 



Ppoissonit, t') =uS{t- t') + 1? . (5) 

The delta function aX t = t' serves to define P{t,t') at all times; trivially, 
the probability density of having a spike at time t and a spike at time t' = t 
is just the delta multiplied by the spike rate in that train, i.e., z/5(t — t'); 
in other words, the presence of one spike is informative of the presence of 
a spike at that time (the same spike). For non-zero time lags (t ^ t'), this 
probability is just the product of the probability densities of having spikes 
at two different times, that is, z/^. For a general spike train we define the 
autocorrelation function as the quantity 

C{t,t') = P{t,t')-u\ (6) 

that is, the joint probability density of having spikes at times t and t', from 
which the probability of finding them by chance (i.e., the rate to the square) 
is subtracted. 

While Poisson trains have an autocorrelation with a single delta func- 
tion at time lag zero and zero otherwise (i.e. Cpoisson(t,t') = ^S(t — t')), 
auto-correlograms obtained from electrophysiological recordings show a de- 
caying peak at non-zero time lags (disregarding refractory effects) sometimes 
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together with a damped oscillatory pattern. A centered decaying peak in 
an auto-correlogram means that spikes tend to occur close together in time, 
forming groups of several spikes. Experimental auto-correlograms with a 
singl e peak and withou t oscillations can be fitted to an exponential function 
(e.g. Bair et al. ( 200 ll )). We therefore consider stochastic spike trains with 
exponential autocorrelations with timescale Tc 



= (T.^it-t'l)6{t'-tf))-ul 

\k,k' I 

= ^./(t - t') + (^^) e-^, (7) 

as illustrated in Fig.([2]B). Since we assume that the input statistics is sta- 
tionary, the input firing rates are time independent and the auto-correlation 
function only depends on time through the quantity |t — Here p = E,!; Up 
and Fp are the firing rate and the Fano factor of the spike count (for infinitely 
long time windows) of the individual trains coming from population pd. The 
connected two-point correlation function defined above is the joint probabil- 
ity density of finding one spike at time t and another at t' within the same 
spike train, from where the probability of observing them by chance, u^, is 
subtracted. Note that this function has two contributions: a delta function 
at zero time lag, coming from the fact that spikes are point events, and an 
exponential dependence measuring the excess probability of finding a spike at 
t' when it is known that there is another spike at t. While normally spikes in 
the same train are positively correlated (Fjv > 1), the auto-correlogram in eq. 
([7j) also describes uncorrelated {Fn = 1, Poisson) and negatively correlated 
spikes (-F/V < 1). With the parameterization we have chosen, fixing the Fano 
factor and changing the correlation time does not keep fixed the amplitude 
of the exponential term in eq. ([7]). However, this choice allows us to fix the 
variance of the spike count in a long time window for each individual spike 
train while varying the timescale of its correlations. To make this clearer, 

^For renewal spike trains, the Fano factors in the above equations are related to the 
coefficients of variation of their inter-spike-intervals, CVp, as Fp = CVp. Note nevertheless 
that our formalism does not require that afferent spike trains are renewal. 
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consider the total number of presynaptic spikes arriving from the spike train 
i of the population p during a time window T, which is written as 



N{T)= r dtY^5{t~t\). 



(8) 



Notice that, since the arrival times are random in such a way that the train 
has the autocorrelation of eq. (171), the number N{T) is a random variable. 
Its mean value is 



(9) 



and its variance caii be ca lculated using the autocorrelation defined in eq. 
(CD as fiRenart et al.l . l2007l ) 



ai^piT) = ([ dtf dt'Y.s{t-mt'-tf: 

-'^ k,k' 



r dt r dtcp(t,t') 

Jo Jo 

UpT + Up{Fp - 1)(T - r,(l - . 



(10) 



Therefore, the variance of the spike count grows linearly with T for long 
windows T ^ Tc, where it takes the value 



^nAT) = Fp^pT . (11) 

(see Fig.(l2]C)). Thus, fixing only the Fano factor in the autocorrelation func- 
tion keeps fixed the variance in the spike count for long T, as this variance 
is independent of r^. Changing Tc does not alter the total spike count fluc- 
tuations, only the temporal precision in which they occur. Notice that the 
inclusion of the Fano factor in the autocorrelation function, eq. ([7]), is con- 
sistent with its definition for long T in eq. (jlj). Notice also from eq. (|TOl) . 
that the variance of the spike count is VpT for short T ^ Tc, and therefore 
the afferent spike train looks like a Poisson spike train when it is sampled 
during brief time windows. However, as soon as T is comparable with the 
correlation time, the variance of the spike count starts to take into account 
the temporal correlations in the spike train, and when T becomes very large, 
all effects are included and the variance is FpUpT, eq. ( ITTi) (see Figl2]). We 
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will show below that, for the LIF neuron we are considering, whether the 
input is seen as having significant temporal correlations or not depends on 
how the timescale of these correlations compares to the neuron's membrane 
time constant. 



3.2 Cross-correlograms 



We have also considered the possibility that spikes in different trains are 
correlated. When the activity of two neighbouring neurons is recorded, the 
cross-correlogram computed from their discharges can s ometimes present a 



single peak w i th or without damped oscillations (e .g. (jPerkel et al.l . Il967 



Aersten et al.l . Il989l : IdeCharms and Merzenichl . Il996l )). A prominent peak at 
zero time lag means that the two neurons tend to fire synchronously, while if 
a dip is observed, when one neuron fires the other is more likely to be silent. 
Very often, th e cross-correlograms can be approximated by an exponential 
function (e.g. (IdeCharms and Merzenichl . ll996l : lBair et al.U200lh ) The cross- 
correlogram is therefore modeled here as an exponential. 



Cpq{t, t ) 




Ppq \J Fp Fq 

2^c 



e 



;i2) 



where Cpq{t,t') is the two-point correlation function between the trains 
in populations p and q {p,q = E,I). This cross-correlation function is il- 
lustrated in Fig.([3]B). As in the case of the autocorrelation defined in eq. 
(I7j), the two-point correlation function expresses the probability density of 
finding a spike of a train in population p at time t along with a spike of a 
train in population q at time t', from which the probability density of finding 
them by chance, I'pi'q, is subtracted. The magnitude of the cross-correlations 
is determined by the correlation coefficients ppg of the spike counts (see its 
definition in eq. ([HD). For the sake of simplicity, we take all the correlations 
in the problem to have the same time constant r^. 
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To better understand the effects of cross-correlations on the input statis- 
tics, we calculate the covariance between the count of spikes emitted by the 
neuron i from population p and the count of spikes emitted by the neuron j 
from population q as an integral of the cross-correlation function, eq. f|T2|) . 

as 



This covariance measures the correlation in the spike count fluctuations dur- 
ing a time T from two presynaptic spike trains. Notice that for T much 
shorter than the correlation time, this covariance is zero, that is, the spike 
counts of the two neurons become independent. This is true because for 
short T the spike trains look like uncorrelated Poisson trains. However, for 
time windows which are longer than the correlation time, the covariance is 
non-zero and approaches a linear behavior. This covariance as a function of 
the integration window is represented in Fig.(l3]C). 

The correlation coefficient is defined as the ratio of the covariance and 
the product of the deviations in the spike counts of both neurons, as 



for long T. Notice from eq. ( fT3l) that the inclusion of the correlation coeffi- 
cient in the cross-correlation, eq. ( |T2i) . is consistent with the above definition. 
Changing the correlation time in the cross-correlation, eq. ( fT2i) . changes its 
amplitude, but not the correlation coefficient between the two spike trains. 
The Fano factors appear in eq. (fT2l) because the time integral of the cross- 
correlation has to be zero if one of the trains does not have spike count 
fluctuations (F/v = 0). 




(13) 



Ppq 



((iV,(T)-(iV,(T)))(iV,(T)-(iV,(T)))) 



(14) 
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3.3 Writing the statistical properties of the total cur- 
rent 

The two-point correlation function of the total afferent current, eq. ([2]), is 
defined as 

C.urrentit,t') ^ ((/(t) - (/(t) ) ) (/(f) - (/(t')))) , (15) 

where the mean current {I(t)) is calculated as in eq.Q. The correlation 
function should take into account both the auto- and cross-correlations of 
the spike trains in the E and / populations given in eqs. (|7l fT2l) . In Fig. (jll) 
we depict a diagram with the correlations present in the E and / neurons, 
whose spikes trains impinge on the same target neuron. There are A'"^; exci- 
tatory neurons firing at rate ue and Nj inhibitory neurons with rate uj. We 
assume that only a fraction /ee ifii) of the Ne (Nf) excitatory (inhibitory) 
neurons are correlated with other neurons within the same population, with 
a correlation coefficient pee (Pii)- Also only a fraction /ei of the excitatory 
neurons are correlated with a fraction Jei of the inhibitory neurons, with a 
correlation coefficient pei = Pie- 

Then, the correlation function of the current, eq. (fTSll . contains several 
contributions: 

Ccurrentit, t') = j| Ne C E{t - t') + j] Nj Cj{t - t') 

+Jl fEE Ne {JeeNe - 1) CEE{t - t') + J| Ni {fijNj - 1) Cnit - t') 
-2 Je Ji Iei fiE Ne Nj CEi{t - t') . (16) 

In this expression, the two first terms come from the auto-correlations of the 
spike trains in the E and / populations. The third and fourth terms take into 
account the cross-correlation between spike trains in the same E or I popu- 
lation. They are positive because both E and / inputs contribute positively 
to enhance fluctuations. The last term incorporates the cross-correlation 
between spike trains one from the E population and the other from the / 
neuronal population, and it is negative. Indeed, positive correlations between 
E and I neurons always reduce synaptic fluctuations because arrival of an 
excitatory spike can be cancelled out by arrival of another inhibitory spike, 
and this happens with higher than chance probability. Therefore, the effect of 
correlations within E or I neurons is always to increase Ccurrent{t, t') in the di- 
rection of their cross-correlation functions, CEEit—t') and Cjj{t—t'), whereas 
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the effect of correlations between E and I spike trains is always to lower the 
current correlation function in an amount proportional to CEi{t — t'). 

Using the choices given in eqs. ([71 [12]), the two-point correlation function 
of the total input current to the neuron can be written as 



current 



{t,t') 



a 



(17) 



where we call the white noise variance, and a the correlation magnitude. 
They are expressed in terms of the model parameters as 



al = JIj Ne UE + Jf Ni ui 

O^^l = Jll^E[iFE-l) + fEEifEENE-l)FEPEE] 

+ J] Ni VI \{Fj - 1) + {fn Nj - 1) Fj pn] 
-2JeJi Iei fiE Ne Nj ./U^ ^JFeFj pei . (18) 

We define the total variance of the current, c"e//) as the sum of the white 
noise variance and the variance generated by correlations, aa"^, that is, 

cr!ff = al{l + a). (19) 

The sign of the correlation magnitude determines the sign of the correlations. 
If a > 0, the current has positive correlations, while if a < 0, the current 
has negative correlations. The minimum physically possible value for the 
correlation magnitude is a = — 1 [^1. If a = 0, the current is uncorrelated. 
Notice that a^jj is very sensitive to the fractions of correlated input trains, 
as these fractions are multiplied by the number of connections from each 
population to the square, which typically are of the order of 10^ — 10"^. Also, 
from eq. (fT8|) it is possible to see that increasing the correlations between 

■^For large enough T (T ^ Tc), the variance of the integrated current, or accumulated 
charge Q(t) — dtl(t), is calculated as 

Var[Q[T)]^ ( dt f dt' Ccurrent{t,t') ^ a^f^T . (20) 
Jo JQ 

Therefore, the variance of the current is just the proportionality factor cr'^ff- Notice that 
since the variance of the current is non-negative, the correlation magnitude has a lower 
bound at a = —1. Lower values are not physically possible because the variance of a 
real-valued stochastic variable cannot be negative. 
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excitatory or inhibitory neurons (either increasing Pee or pn) enhances the 
total variance, whe reas correlations between exci tatory-inhibitory pairs {pei) 
always decrease it ( Salinas and Sejnowskil . 2000 ). 

The parameters Tc and a which appear in the definition of the correlation 
function of the current, eq. f|T7j) . fully characterize both the temporal range 
and the intensity of the correlations relative to the white noise variance o"^. 
Although it is important to understand the effect of these two parameters 
on the neuronal firing respons e separately, prev i ous st udies have not studied 
this problem. For instance, in lFeng and Brownl (120001 ) only the case = is 
considered, which precludes the characterization of the t empo ral scale of the 
correlations. On the other hand, ISalinas and Sejnowskil (120001 ) have changed 
simultaneously the values of t^. and a in their simulations. 



3.4 The sum of a large number of independent non- 
Poisson spike trains is not Poisson 

One point deserves clarification at this moment. It refers to the way many 

simultaneous spike trains add up. The sum of many indepen dent spike trains 

has been commonly app r oximat ed as a Poisson process (e.g. (jPaley and Vere-Joned . 
19881 : lAmit and Brunei Il997al )). Although this is in some cases a good ap- 
proximation, it is worth emphasizing that the sum of many independent 
point processes is not, in general, Poisson. Indeed, the c onditions for the sum- 
proces s to be truly Poisson are rather restricted (see e.g.. lDaley and Vere- Jones 
( 119881 )). In particular, one of the conditions implies that, on any time in- 
terval, only one event can be observed from each individual point process. 
However, this is only expected to be a good approximation for time windows 
much shorter than the typical inter-spike-interval of each neuron. In general, 
a neuron will receive one, two or more spikes from the same presynaptic neu- 
ron before it fires, not just at most one spike, as the Poisson approximation 
strictly requires. 

As expected from the rules of probability, adding up many independent 
spike trains results in a global spike train with an autocorrelation function 
which has exactly the same functional form as those of the individual trains 
(note, however, that higher order properties are not necessarily conserved, 
i.e., the sum of many renewal processes may not be renewal). In particular, 
when independent spike trains with an autocorrelati on C(t,t') are added, 
the summed train has an autocorrelation N x C{t, t') ( (IMoreno et al.l . 120021 ). 
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see also eq. (ITBI) with Cee(ilei) = and Je{i) = !)• We further noted that 
even in the diffusion hmit (i.e. N oo), when the individual firing rates u 
are renormalized hj u/N to yield a finite two-point correlation function, the 
auto-correlation function of the total input has exactly the same shape as the 
auto-correlation fun ction of the individual spike tr a ins. Later works have also 



used this property f|Renart et al.l . 120071 : iLindnerl . l2006l : iCateau and Reyed . 
20061 : IPoiron et all l2006l )~ which is relevant to describe the temporal aspects 



of correlations in networks of spiking neurons. 

Here we exemplify the above result using the expression for the correlation 
function of the current, eqs. (117H18I) . It is easy to see that the total current 
will show temporal correlations beyond the trivial delta function at zero time 
lag whenever a is different from zero and Tc is not infinity. If the afferent spike 
trains are independent (p = 0) but they have exponential auto-correlations, 
as those in eq. ([7]), then a will be different from zero (see eq. f|T8l) ). This will 
happen for any choice of the number of connections and synaptic strengths 
(different from zero). Therefore, no matter which choices of the parameters 
are taken, the correlation-function of the total current can never correspond 
to a Poisson process with a larger rate, since an input Poisson process will 
produce a correlation function equal to Ccurrent(t,t') = cr^5(t — t'). The 
above argument does not depend on the condition that the correlations are 
exponential, but rather the same conclusion can be achieved from eq. (fT6!) 
using any plausible autocorrelation function CE(t,t') and Cj(t,t') different 
from a delta function (i.e., different from the autocorrelation function of a 
Poisson process). 

3.5 When the current can be approximated by a Gaus- 
sian current 

We have described the statistical properties of the total current, I(t), gen- 
erated by correlated spike trains. However, the firing response of a neuron 
receiving that current is not yet completely determined by the mean and 
two-point correlation function of the current alone, eqs. (11711181) . These 
quantities describe the statistical properties of a stationary current up to 
second order, but higher order statistics in the input could also play a role 
in shaping the firing response of the neuron. However, if the current J(t) can 
be approximated by a Gaussian process, then, the current would be fully de- 
scribed by its mean and two-point correlation function. In fact, Gaussianity 
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naturally holds when the neuron is receiving a large barrage of uncorrelated 
spikes per second each one inducing a membrane depolarization J very small 
compared to the distance between the threshold and reset potentials, i.e., 



J/{Q — H) <^ 1 (iRicciardil . 119771 ). When inputs are correlated, the net effect 
of correlations is to increase effectively the size of the unitary depolarization 
(for positive correlations), since two or more spikes are more likely to occur 
together in time. We have estimated this renormalization in the size of J and 
determine that for the Gaussian approximation to be valid with correlated 
input spike trains the condition 

IF 

^Q3^(l + /iVp)«l (21) 

should hold. This is a heuristic formula, and it is explained qualitatively 
as follows. The worst condition in the presence of correlations occurs when 
the correlation time is zero, that is, when there is some chance that two 
or more spikes arrive at the same time, increasing the effective size of each 
spike and worsening the Gaussian approximation. One can estimate the 
mean number of spikes arriving together to be F (1 + fNp), which grows 
with the variability of the spike trains, the number of correlated pairs and 
their correlation coefficient. As long as this number multiplied by J is small 
compared to 9 — if, i.e., eq. (pT|) . the Gaussian approximation is expected 
to be appropriate. This indicates that if either F, fN or p increases too 
much, the Ga ussian limit will b e broken. When condition (12T|) is largely 



broken, as in (IKuhn et al.l . l2003l ). the Gaussian approximation is no longer 
valid. In particular in the limit of large N, it should hold that p ~ 1/ fN, so 
the correlation coefficients cannot remain finite as the size of the population 
of neurons with significant cross-correlations increases. If condition fl2T|) is 
satisfied, the input current in our problem can be described as a Gaussian 
stochastic current fully defined in terms of the mean /i = JeNei^e — JiNjUj, 
the variance a^, the correlation magnitude (a) and correlation time (tc), as 
expressed in eq. ((1 



3.6 Choosing the connectivity and correlation param- 
eters 

Because we are dealing with a model with many free parameters (see eq. 
f ITS]) ). here we fix most of them or make choices within a range of real- 
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istic values. A single neuron receives typically Nf] ~ 5000 — 60000 exci 



tator y connections from other neurons (jCraggi . 119671 : iDeFelipe and Farinad . 
19921 ). This accounts for 80 per cent of the total number o f synap s es; th e 



remaining 20 per cent corresponds to inhibitory synapses (lAbelesl . Il99ll ). 
The dynamical range of cortical neurons lies in the interval z/ ~ — 200Hz 



(lAlbrightl. 119931) although lo wer rates are much more probable than higher 
o nes (Rolls and TrevesI, 1998 ). Synaptic strengths are between J = 0.1 — lm\^ 



( (lAmit and Brunei! . Il997al ) ; see the references therein) . Assuming a thresh- 
old of 20mV above the resting potential of the neuron, these unitary events 
represent a fraction in the range J ~ 5 10-3 - 10-2 of the total path to be 
travelled from rest to firing threshold. 

Fano factors of the spike count lying in the interval 1 — 1.5 reveal higher 
i rregularity in the neuronal discharges than that expected frora Poisson trains 



19931 : IStevens and Zadoii . Il998l : ICompte et al.l . [20031) 



(iDeanl. Il98ll: ISoftkv and KochI Il993l: IShadlen and Newsomd . Il998l: lAlbright 



The timescale of correla tions varies from a few to several hun dred mil- 
liseconds, Tr 1 — lOOmg (iTs'o et al.l. Il986l : iGochin et al.l . Il99ll ). For in- 



stance, in (jdeCharms and Merzenichl . Il996l ) the correlated activity of pairs 
of neurons in primary auditory cortex in cats was recorded. The mean 
half-width at half-height of the cross-correlograms peaks computed from 
these pairs was ~ 10ms, which corresponds to a correlation time scale 
Tc = 10ms/ln2 ~ 15mg . 

Zohary et al.l (Il994j ) have reported correlation coefficients of p = 0.12 be- 
tween neighbouring cells in the middle temporal visual area (MT, or V5). If 
any pair of neurons in a group of thousand units were correlated with such a 
magnitude and projected to a same target neuron, the magnitude of the input 
fluctuations would be unrealistically large (see eq. (fTSjl ). In fact, the value 
p = 0.12 only holds for units within local circuits, because it is k nown that 



more distant neurons display much smaller correlation coefficients ( iLee et al. 



19981 ). Although a "mean" correlation coefficient could have been considered 
J~we have taken into account the heterogeneity of pairwise correlations ob- 
served in the cortex by assuming that only a fraction fpg of neurons between 
populations p and q are indeed correlated with the same correlation coeffi- 
cient ppq. This fraction could represent the portion of presynaptic neurons 
located in the surroundings of the target neuron, and thus embedded in the 



mean correlation coefficient can be obtained by averaging the p of each pair of 
neurons: (p) = J f{p)dp. 
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same local circuits as this neuron, or a far neuronal population displaying 
correlations between its units and projecting to the same target neuron. To 
bound the effects of input correlations, we assume that around one per cent 
of the presynaptic neurons can be correlated. Such a small value of fpg still 
produces a large effect on the correlation magnitude (see eq. f|T8|) ). as will 
be also clear in section (17. 2p . 

The values of /x, o"^ and a therefore lie within rather broad intervals. As 
an example of the typical values they can take, if a neuron receives = 10^ 
excitatory connections, Nj = 2 10^ inhibitory connections, with synaptic 
strengths Je = 5 10~^ and Jj = 2 10~^ (in units of the threshold), and they 
are firing at ve = I'l = 5Hz, then /i = 50Hz and cr^ = 5.3Hz. Assuming 
that there are only correlations between pairs of neurons in the E population 
{Pei = Pi I = 0), being /ee = 0.1 the fraction of those which are correlated, 
then a = 0.85 if Fe = Fj = 1.5 and the correlation coefficient is pee = 0.01, 
or a = 4 if pee = 0.1. When we present results from numerical simulations, 
the parameter values considered will be of the order of the ones mentioned 
above. 



4 Two ways of transforming the non-Markovian 
problem into a Markovian one 

As we have explained in the introduction, we aim at calculating the output 
firing rate of a LIF neuron receiving a correlated input as described in the 
previous sections. The main technical problem to study the response proper- 
ties of a neuron driven by correlated inputs analytically is that the stochastic 
process defined by eq. ([T]) with a current having correlations as in eq. flTTl) 
is non-Markovian, that is, the time derivative of the membrane potential at 
each time depends on the past history of the afferent current, not only on 
its present value. This fact complicates the solution of the problem. How- 
ever, the process defined in eqs. ([H [T7|) can be expressed in a Markovian 
way by generating the curren t I{t) with the help of an Ornstein-Uhlenbeck 



process (IMoreno et al.l . 120021 ). The stochastic current I{t) generated in this 
way displays exactly the same exponential correlations as eq. f|T7j) . This 
duplicates the number of variables, but puts the problem in a suitable form 
(see eqs. fl22| [23]) and fl32| [331) below). We have found two different ways of 
representing the correlated Gaussian current I{t) satisfying eq. f[T7|) . They 
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only differ in the values of a for which they hold. While one of them is more 
general because a can take any physical value (including both positive and 
negative correlations), the other is simpler, although it can be only used for 
a > (positive correlations). 



4.1 The first Representation for the dynamics of /(t) 

The first representation of the current lif) that we discuss here generates 
both positive [a > 0) and negative {a < 0) correlations. It has the form 



I{t) =11 + auivit) + au,-^z{t) 




(22) 
(23) 



where T]{t) is a white noise random process with mean zero and unit variance 
(i.e., {T]{t)) = and {vit)r]{t')) = 5{t - t')), /3 = VTT~a - 1 and z{t) is 
an auxiliary colored random process which obeys th e Ornst e in-Uh lenbeck 
process f l23p with the same white noise 7]{t) (see, e.g., (iRiskenl . [Tosih l 

It is easy to check that the current defined in eqs. (12^ [2311 generates a 
Gaussian waveform with mean (/(t)) = yU and exponential correlations as in 
eq. f|T7|) . Defining i{t) = (/(t) — fi)/(rw we have 



/3 



:Z{t) 



2Tr 



^ mz{t')) + w)z{t)) + ^ {z{tw)) 



S{t - t') + 

(24) 



Assuming that t' > t without loss of generality (because {i{t) i{t')) is sym- 
metric in the steady state), the third term on the right side of the eq. ^IM 
vanishes. The second and fourth terms are calculated using the solution of 
the stochastic equation, eq. (123|) . 



z{t) 



ds e'l'^" r]{s) 



(25) 



with the initial condition z{0) = 0. We find that in the stationary state 
{t,t' ^ oo, t' — t = constant > 0) 
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{z{t)z{t')) = e-(*'-*)/"= . 

Using these identities, the correlation function of the current I{t) defined in 
eqs. (12211231) . denoted Ccurrent(t,t'), can be written as 



C, 



current 



6it-t) + ^-—e 



(26) 



from where one sees that the correlation magnitude a is related to the new 
parameter /3 by a = /?(2 + an equation which has two independent solu- 
tions, P = + a — 1, both equally valid. We have chosen P = vT+~a — 1. 
Remember that a has a lower bound in —1, which is obtained with j3 = —1. 
For each solution there is a one-to-one mapping from a G [—1, +oo) to (3, and 
thus, all physically realizable positive and negative correlations are included 
in this formalism. 

The joint process defined by eqs. ([1], [221 ES]) is Markovian and driven 
by white noise. Thus, the problem of finding the output firing rate can 
be form ulated accord ing to its associated stationary Fokker-Planck equation 
(FPE) fiRiskenl . Il989h . The system of eqs. ([D [221 [23]) can be simplified by 
the linear transformation 



to obtain the set of stochastic equations 



(27) 



xit) = + J—v{t) + -=zit) 

'^m V '^rn \j^ra^c 

Tc V 

The FPE associated to these two equations is derived in detail in Appendix 
[Bl and is given by 
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, L 2 d d f3z 



-Tm5ix~V2H)Jpiz) 



(28) 



where the differential operator is defined as Lu = ■§^u + and k = 
\/rc/Tm- Besides, H = and 6 = ^^^>^. The true reset and threshold 

values in the new variable x are \/2H and a/20, respectively. The func- 
tion Pp{x, z) is the steady state probability density of having the neuron in 
the state {x,z). Since the problem cannot be solved exact l y as i n the one- 
dimensional diffusion case (see e.g. f Ricciardi . 1977 : Riskenl . Il989 )). we have 
used a perturbative expansion of the FPE in powers of = ^J^\^J^c■ 

A key quantity is the escape probability density flux at fixed z, Jpi^z). 
Associated to the FPE (!28l) there is a proba bility density v ector flux J/3(x, z) 
defined at each point on the plane (x, 2;) (IRiskenl (119891 ) . Chapter 6, pag. 
133). It measures the direction and the intensity of the probability density 
flux at each point (x, z). For our FPE it has the expression 



The probability density flux satisfies the so-called continuity equation 

V. J^(x, z) + r^5(x - V2H)Jfs{z) = , (30) 

where V = [^5^] is the divergence operator. Eq. fl5U]) is equivalent to 
the FPE (!28l) . and expresses the conservation of the total probability over 
time. The escape probability density flux J/si^z) is just the x-component of 
the probability density flux (129|) evaluated at threshold: 

M^) = ^ (-^ - - - "^') ^^<^- ■ (31) 

The escape probability density flux appears in eq. fl2Sl) as a source term 
representing the reset effect: whenever the potential V reaches the threshold 
G, it is reset to the value H with the same z distribution that it had when 
it escaped. This holds because the particular value of z at the moment of 
the generation of each spike has to be conserved for the next inter-spike 
interval since, as opposed to V, z is not reset after an action potential. 
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Crucially, this self-consistency condition complicates the solution of the FPE 
(125]) . The escape probability density flux in eq. (^11) is exact if r^e/ = 
(or approximately if Tc ^ r^e/, because in this case the variable z has slow 
dynamics and therefore its probability distribution at a time Xre/ after the 
emission of an output spike is very similar to its distribution at the moment 
of the spike). 

Let us notice that this first representation of l{t) can be used not only for 
analytical calculations but also for the numerical generation of exponentially 
correlated currents, as it is shown in Fig. ([5]), were we show the exponential 
two-point correlation function of a current I if) generated numerically by eqs. 

[25]) and that predicted by eq. (12B]) . Additionally, in a later section this 
representation will be employed in the numerical analysis of the response of 
LIF neuron to negative and positive correlations (Sec [7]). 



4.2 The second Representation for the dynamics of /(t) 

An afferent current lit) with non-negative exponential correlations obeying 
eq. ffTT]) can also be generated by the set of equations 



/(t) =/i + a^r/(t) +(T^,/— y(t) (32) 




y(t) = -f + J-C(t). (33) 



Here ri{t) and C,{t) are two independent white noise processes with mean zero 
and unit variance. The two-point correlation of /(t) can be calculated as in 
eq. fl24]) . with the exceptions that /3 in eq. fl2^ is replaced by ^/ol and the 
two white noises are not correlated. Then, only the terms analogous to the 
first and fourth terms in eq. (!M]) are nonzero. Because \fa is a real number, 
the correlation magnitude a has to be positive in this representation. 

From the set of eqs. (P, [32], [33]) and making the linear transformation 
defined in eq. ([27]) we obtain the FPE (the derivation is similar to the one 
presented in Appendix [B] ) 



^ k"^ k dx 



Paix,y) = ~TmS{x ~ v^iJ) J„(y) . (34) 



The linear differential operator L„ has been defined as in Sec. 14.11 and 
again k = \Jt\Jt^. As in the previous representation, the escape probability 
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density flux Ja{y) acts as a source term injecting current at the reset potential 
at the same rate and with the same distribution in y as when it escaped 
(here we have to assume that r^e/ = 0, or Tc ^ r^e/ = 0). It represents 
the probability current in the direction of x evaluated at threshold. The 
probability density vector flux for this FPE is 

Its continuity equation is 

VX{x,y) + T^5{x-y/2H)J^{y) = Q, (36) 

equivalent to the FPE ( l34l) . and the escape probability density flux is defined 

as 

Jc.{y) = ^ (^-^ - X - Pa{x,y)l^^Q , (37) 

The FPE fl34|) will be useful for finding a perturbative solution to the first 
passage time problem in powers of A; = sJ'tJt^, that is, for short t^. We 
have found this representation especially useful for this purpose, since this 
limit is harder to obtain from the first representation. 



4.3 Conditions over the probability density distribu- 
tion and probability density flux 

For both representations of exponential correlations, the probability density 
and the escape probability density fiux must be determined such that they 
obey the set of conditions: 

1. Normalization of the probability density, 

dx / dw Pr{x,w) = 1 (38) 

-oo J — oo 

2. Threshold vanishing condition, 

Pr{V2Q,w) = Q (39) 
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3. The output firing rate is given by 

/oo 
dw Jr{w). (40) 
-oo 

4. The escape probabihty density flux has the form 

1 d 

Jr{w) = - — —Pr{x,w)\^^^^ (41) 

where r = a, /? is the representation label, and w stands for both z and 
y. Condition (l38l) is a normalization condition stating that with probability 
Trefi^out the ueurou is in the refractory period. Condition (139|) states that 
at the firing threshold, the probability density has to be zero (notice that 
the density can be defined to be zero above threshold, so this condition is a 
continuity condition at the threshold boundary). This is so because otherwise 
the flux in eq. pij) . which includes a derivative evaluated at threshold, 
would be infinity. The output firing rate of the neuron, Uout, is obtained by 
integrating the escape probability density flux over w, condition fHUl) . To 
write down Jr{w) in condition fHTl) we have used the condition fl5^ applied 
to eqs. (pT!) and (!37|) . Notice that precisely because of condition (l39l) . the 
escape probability density flux, eq. (14T!) . has exactly the same expression in 
both representations. 

While solving the FPEs in both representations, it is usually easier to 
employ the exact condition 




which is directly obtained from the equations for z or y (eqs. ( |23ll and (l33il 
respectively) and the condition that there is a fraction VoutTref of neurons in 
the refractory state. Eq. fH2l) states that the marginal distribution of w is 
a normal distribution, as it corresponds to the stationary distribution of an 
Ornstein-Uhlenbeck process (eqs. f l23|33l) ). Notice that it is consistent with 
eq. 

5 Output firing rate for long and short Tc 

The next step is to compute the output firing rate using the FPEs. We 
found feasible to evaluate it from the first representation, eq. ( I28l) . for long 
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correlation times (tc ^ r^), and from the second representation, eq. ([31]), 
for both short and long correlation times. In the two cases we propose a 
perturbative expansion of the solution Pr{x, w) in powers of a representative 
temporal scale parameter (a convenient power of A; = y^TcT^)- 

5.1 Long Tc limit using the first representation 

In this limit we expand both the probability density and the escape proba- 
bility density flux as a series in powers of = Jrm/Tci 



Pp{x, z) = hoix, z) + k'^hi{x, z) + k''^h2{x, z) + 0{k~^) (43) 
Jp{z) = \p{z) + + k-^J^A^) + 0{k-^) . (44) 

Each term Ji^p in this expansion must satisfy the condition fj^TI) . 

1 d 

Api^) = - — -Q^Hx^^)\x=V2e ■ (45) 

Let us proceed to the calculation by replacing the expansions ( l43l l44l) into 
the FPE ( l28l) . This substitution generates a set of equations for Pi^j3 that 
can be solved consistently with conditions (1381 - l40i) . The main steps of the 
procedure are given in Appendix [Cl 

The resulting escape probability density flux Jpi^z) is found to be, up to 
0(A;-2) 



[^{2 + [3)ui{R{e)-R{H)) 



aC 



1 - I^oTre/ 
' 1)], 



2 2 



r„z/o(i?(e) - R{H)f &R{&) - HR{H) 



1 



t^OTref 



V2 



Here -R(t) = e* (1 + erf(t)), where erf(t) = du is the error 

function. The rate uq is just t he firing rate of a LIE neuron driven by a white 
noise input with variance cr^ (IRicciardil . 119771 ) 



-1 



ref 



re 2 
^/^Tm I dt e* (1 + erf(t)) 



(46) 
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Notice that C is independent of Tc- 

We then use condition (HUj) to find the output firing rate vahd for long 
and fixed a 



^out — t'o H C . 



(47) 



Several important conclusions can be extracted from this simple expression. 
First, the effect of correlations is linear on a for long r^. That is, doubling 
a doubles the firing rate above the rate without correlations, uq. Notice also 
that a can be positive or negative, so for negative correlations the effect on 
the rate is the opposite than for positive correlations. Second, the firing rate 
of a LIF neuron with exponentially correlated input approaches the firing rate 
in the absence of input correlations as the correlation time increases. This 
happens because, as the correlation time becomes longer than the membrane 
time constant (tc 3> r^), the neuron filters out the fluctuations provoked by 
input correlations. As a consequence, in the long Tc limit and for finite cor- 
relation magnitude, the correlated input to the neuron can be approximated 
by a white noise process. Therefore, in this limit, the observation of only the 
output firing rate of the neuron does not allow to distinguish a correlated 
input from other generated by the sum of many Poisson point processes in 
the diffusion limit. This result is important, as it determines when inputs 
with complex correlation structure (i.e., with several correlation timescales) 
can be approximated by white noise. 

5.2 Long Tc limit using the second representation 

In this section we calculate the firing rate in the long Tc limit using the 
FPE gS>. Although the FPE ([MD is more restrictive than the FPE (it 
only describes positive correlations, a > 0), it is analyzed here because it is 
much simpler and can also be solved in the limit in which a/Tc is constant, 
i.e., for arbitrarily large a. In fact, the FPE (1281) has been studied in the 
limit in which a/Tc approaches to zero as Tc rises, because the correlation 
magnitude was constant in that case. The real advantage of using the second 
representation is that the predicted firing rate is valid for larger values of a, 
compared to the formula (147|) . 

We start from the FPE (IMI) and assume that the factor ^/a/k is constant 




Tc/'Tm)- We thus define 
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k 



7 



Inserting this parameter in the FPE flMl) we obtain 



(48) 



Pa{x,y) = -TmS{x - V2H)Ja{y) 



(49) 



where Ja{y) reads as in eq. (l4Ti) . The solution of the FPE (H9l) along with 
the conditions fl38tl42p in the long Tc limit is found by expanding Pa{x, y) and 
the escape probability density flux Ja{y) in powers of while keeping 7 
fixed as 



Pa{x,y) =rQ{x,y) +k Vi(x, ?/) + 0(A; ^) 

^a(l/) = ^a,o(l/) + k-^JcM + 0(A;-^) . (50) 

To obtain the coefficients ri{x,y) and Ja,i{y) we proceed as in section (15. ip . 
In particular, conditions (|38] - I^T1) are imposed order by order. The main steps 
of the calculation are given in Appendix [Dl The results are here summarized 
up to order The density Pa{x,y) up to 0(A;°) is 



Pa{x,y) = TmJaiy) & 



(x-jy) 



du H{u - V2H) 



(51) 



(7i(t) = 1 if t > and it is zero otherwise) where the escape probability 
density flux Ja{y) up to the same order is 



2'KT„ 



e 2 



du e 2 



dve 2 



(52) 



The output flring rate at leading order is obtained by integrating Jaiy) over 
y as 



T^out 



27rr„ 



dy e 



due 2 



dve 



(53) 



Notice that this formula has been derived for r^e/ = 0. Notice also that only 
the leading order /c° has been calculated. This order, however, gives a firing 
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rate which is much more accurate than the firing rate obtained using the first 
representation in the same hmit, eq. (14 7p . This is true because the firing 
rate in eq. fl53|) depends on 7, which is a function of the parameters a and k 
(7 = ^Jajlz). If the zero-th order firing rate in eq. fl53l) is expanded in powers 
of for fixed a, the same firing rate in eq. WJ\ is found when correlations 
are positive (In particular, if a = 0, then 7 = and Vout equals i^o, i.e., the 
well-k nown expression for the firing rate of a LIF neuron driven by white 



noise (IRicciardil . 119771 )). This means that eq. (153!) is exact up to 0(A;~^), 
and therefore the corrections to the firing rate arising from the terms 0{k^'^) 
in the expansion (150!) should vanish. This is indeed the shown in 

Appendix [Dl In addition, the higher other corrections found in the expansion 
of eq. (1531) improve the prediction provided by eq. (HTj), especially when a 
is very large, or when a/Tc is kept constant (i.e. 7 constant) in the long Tc 
limit. 

The firing rate in eq. fl53l) has a very simple interpretation. Since y 
is slow compared to the voltage dynamics (r^ > r^), the firing rate of a 
LIF neuron receiving correlated noise can be calculated by multiplying the 
firing rate of the LIF neuron receiving a frozen current proportional to y 
(plus mean fi and white noise with amplitude a^', this correspond s to the 
function into the square brackets, divided by ( Ricciardi . 19771 ) |1) and 



the probability density of having the value y, which in this case is a normal 
distribution because y obeys an Ornstein-Uhlenbeck process, eq ( |33i) . This 
expression, obtained here to describe the effect of exponentially correlated 
inputs, has also been used to describe the effects of synaptic filtering with 
both fast and slow linear synap ses on the output firing rate of a LIF neuron 



( iMoreno-Bote and Pargal . |2004| ) 



One important feature of the firing rate in the long Tc limit, eq. flS51) . is 
that it does not change as 7 is kept fixed, that is, as the ratio a/r^ is kept 
constant. This means that to obtain the same output firing rate for a longer 
correlation time, one has to increase proportionally the correlation magni- 
tude so that the loss of temporal precision is counterbalanced by an increase 
in the excess of synchronous afferent spikes. This suggests a proportional- 
ity law that could be tested experimentally using in vitro current injections 
in which both the magnitude and the temporal precision can be controlled 
independently (using e.g. eqs. fl23|) ). Furthermore, for non-exponential cor- 



^Note that the function within the brackets can be expressed in terms of the error 
function, similarly to eq. (j46p 
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relation functions (e.g. oscillatory), it might be possible to define an effective 
correlation magnitude and an effective correlation time so that the output 
firing rate of the neuron will not depend on them individually, but on their 
ratio. 

5.3 Short Tc limit using the second representation 

In the regime of short Tc the FPE (134|) is employed to find the output firing 
rate. Although the set of eqs. ([1], [321 [33]) only generates positive exponential 
correlations, we use them because its associated FPE can be solved pertur- 
batively in powers oi k = \JtJt^ and ^/a. We have found the FPE (pSj) 
including both positive and negative correlations too involved to be studied 
in the small k limit. Although the firing rate computed in this limit from the 
FPE ( 1341) is derived only for positive correlations, when the same formula is 
employed for negative correlations, one finds an excellent agreement with the 
numerical results. This fact suggests that the analytical continuation of our 
formula to negative correlations (a < 0) could match the true expression for 
that case. 

Even when using the FPE f p^ . valid for positive correlations, the short 
Tc expansion is not easy to obtain. This is because of the self-consistency 
condition ( |4TI) . which is hard to deal with. However, if the correlation time 
Tc is short compared to the refractory ti me Tre-j {Trfj ps> Tr\ the escape 



probability density flux can be written as (IDoering et al.l . Il987l ) 



Ja{y) = Vout r— , (54) 

V 27r 



which solves automatically the conditions fl40l - [411) . This approximation is 
good because after a spike the variable y approaches its Gaussian stationary 
distribution in a time r^, which we are taking shorter than T^^j- 
We now look for a solution of the FPE (1341) of the form 

P„(x, y) = fo{x, y) + A;/i(x, y) + 0{k^) , (55) 

and at the same time we expand the escape probability density flux in 
powers of k or, equivalently, the unknown output firing rate as 

T^out = ^eff + kui + 0{k'^) . (56) 
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It can be shown that the solution fi {x, y) obtained from the perturba- 
tive expansion does not satisfy the vanishing boundary condition (15^ (see 
Ap pendix [E)). To addre ss this problem, we extend the form alism described 



in (|I)oering et al.l . 119871 ) to solve the short Tc limit. As in (iDoering et al.l . 
19871 ). our problem does not have a perturbative solution for short Tc, and 
it is necessary to solve a boundary layer problem. Details of these calcula- 
tions are given in Appendix [El Briefly, the solution P*°*"'(x, ?/) is obtained 
as the sum of the perturbative and an additional solution, valid close to the 
threshold, that we call boundary solution f^{x,y): 

Pa'^Kx,y) = fo{x,y) + k[Mx,y) + f,{x,y)] + 0(P) . (57) 

It is now possible to satisfy the condition (l39l) up to order k. Finally, the 
firing rate up to order k can be calculated using the condition (l38!l . resulting 

l^out = l^effia) - ay/TcTml'oR{Q) , (58) 

where uq is defined as in eq. (H6l) and 



•e/ + V^Tra dt 6*' (1 + Crf (t)) . (59) 



The effective reset and threshold potentials are defined as Ggf /■ = ® and 
Heff = ■^—^^=- An important implication of eq. (l58l) is that when Tc = 
the output rate is Ueffia), equivalent to that of a LIF neuron receiving an 
uncorrelated input (white noise) with an effective signal variance 

alff = al{l + a). (60) 

In this case, the solution is exact for all a. When ^ 0, it is correct only 
for small values of both k and a > 0. This expression indicates that when 
the correlation time is zero, the effect of the input correlations is to increase 
the white noise variance by a factor equal to 1 + a. 

A general expression for the firing rate of any IF neuron is presented in 
Appendix [Fl Again, for = 0, the firing rate is that of the IF neuron with 
input white noise but with a renormalized variance as in eq. fl60|) . From this 
maximum firing rate at optimal synchronization, the firing rate decreases as 
—^fTc for fixed a (eq. fl99l) . analogous to eq. fl58|) for a LIF neuron), showing 
that this large sensitivity to variations in the correlation time of the inputs 
is a general property of IF neurons. 
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First Representation 


Second Representation 


Short Tc 


Not found 


I'out = ^ef}{a) - ay'TcTmi'lR{Q) , eq. ([SHD- 

Valid for small and positive a, and 
exact for all positive a when Tc = 0. 


Long Tc 


l^out = 1^0 + ; 

' C 

eq. (iTD. 

Vahd for small a, 
positive and negative. 


2 

1 TOO 7 ^— 

with 7 = ^JaTm/Tc, eq. ([53]). 
Valid for all (even large) positive a. 



Table 1: Analytical expressions for the output firing rate of a LIF neuron 
receiving exponentially correlated inputs with magnitude a and correlation 
timescale Tc for the two representations of the current in both the short and 
long Tc limits. 



6 Summary of the analytical results 



The analytical results, obtained in the first and second representations of the 
current, and in the short and long Tc limits, along with the conditions upon 
which they are valid, are summarized in Table ([T]). 

The second representation allows one to calculate the firing rate for both 
short and long Tc, while the first representation only a llows the calculation 
of the firing rate for long Tc. In (IMoreno et al.l . |2002| ) we used the second 
representation to obtain the firing rate for short r^, and therefore the expres- 
sion shown here is the same at that found there. On the other hand, using 
the second representation for long Tc, here we have been able to find a new 
expression for the firing rate , eg. ([53]). wh i ch can be applied for arbitrarily 



large a, while that found in (iMoreno et al 
tion, eq. (1171) . could only be applied for small a 



2OO2I ) using the first representa- 
The expressions valid for 
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long Tc, eq. fH7|) and eq. (135]) . are in fact equivalent when the limit a — > 
is taken (Appendix [D]). Note, however, that eq. fl47l) can be employed for 
negative a, while eq. (I53l) can only be used for positive a. 

7 The effect of correlations on the firing re- 
sponse of spiking neurons 

In this section we take advantage of the machinery developed in the previous 
sections. First, the prediction of the firing rate as a function of the timescale 
and magnitude of input correlations is used to study the role of synchrony on 
the stationary firing response of a LIF neuron. Second, we study the firing 
response to modifications of the correlation magnitude. Numerical solutions 
of the voltage and noise equations to generate exponentially correlated noise 
are employed in this case. 

7.1 Stationary firing response 

Although we have calculated the output firing rate both in the limit Tc ^ 
and in the limit Tc ^ r^, before the effect of Tc and a on the firing rate is 
described, we develop an interpolation procedure that allows us to use a single 
expression for all values of Tc- The interpolating curves have been determined 
by setting the firing rate in the short correlation time range (tc < r^) as 



where Ai and A2 are unknown functions of a and of the neuron and input 
parameters, while in the long correlation time limit (tc > r^) the expression 
given in eq. (HTll . 



was used. The functions Ai and A2 are determined by interpolating these two 
expressions with conditions of continuity and differentiability at a convenient 
interpolation point Tc^inter ~ T-m- Although we have calculated analytically 
the function Ai (eq. fl58|) ) for small a, this procedure takes into account 
higher order corrections which match more accurately the observed data for 
larger values of a, as those used in some of our simulations (see below). 
Therefore, eqs. (I6m62p provide an analytical formula for the output firing 




(61) 



i^out = 1^0 + aC/ T, 



(62) 
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rate of a LIF neuron receiving exponentially correlated input which is valid 
for all Tc- 

We have performed numerical simulations of a LIF neuron driven by 
Gaussian exponentially correlated input using eqs. (P, [221 123]). We use 
them to check the analytical results given in eqs. Wl\ [53| [58]) and validate 
the interpolation made between the regimes of short and long Tc, provided 
by eqs. ( l6Tll62l) . When positive correlations are considered (a > 0), the 
interpolation procedure is robust against changes in n and a^. Crucially, 
the interpolating point Tc^inter ~ does not vary too much, so that it can 
be maintained approximately fixed for all input parameters. For negative 
correlations we have found more convenient to add to the expansion in eq. 

an extra term: Ugut = i^o + « C/Tc + Bi/r^. Then, this expression is 
made to match at Tc^mter ~ Tm the short Tc regime given by the equation 

^out = ^eff + B2y/rc. 

This interpolation is compared with simulation results in Fig. ([6]), pro- 
viding good fits. The firing rate increases as Tc decreases (at fixed positive 
a). This corresponds to the intuitive result that positive correlations be- 
tween the presynaptic events produce a larger enhancement in the output 
firing rate as the temporal window over which they occur decreases. On the 
other hand, when negative correlations are present in the input, the effect of 
Tc is reversed: the firing rate increases as Tc increases. Negative correlations 
produce a deficit in current fluctuations that decreases the firing rate. This 
deficit is not noticeable if Tc is very long compared with r^. These results 
show that correlations with fixed magnitude a have different effects on a tar- 
get neuron depending on the value of their correlation timescale. Correlations 
are not perceived by neurons if the temporal precision they occur is larger 
than the membrane time constant of those neurons. As it can be appreciated 
in Fig. ([H]), when Tc is of the order of 40ms (twice longer than r^) the out- 
put firing rate of the neuron approaches the firing rate obtained by an input 
without correlations (a = 0, dashed-dotted line). Only if Tc < Tm = 20ms, 
the presence of correlations is noticeable. As noted above, this implies that, 
from the point of view of the output firing rate, correlations in the input 
can be neglected, i.e., a white-noise input description is appropriate, when Tc 
is significantly longer than (note, however, that there is not an absolute 
value of Tc for which correlations can be neglected, rather, this value will 
increase with a). 

In Fig. ([7]) we use the predictions of eqs. fl47|53l) valid for long r^. 
Here, large values of correlation magnitude, a, are used. The predictions 
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are compared with simulations of neurons in the subthreshold (left) and 
the suprathreshold (right) regimes. The subthreshold and suprathreshold 
regimes are defined by fiTm < and /iTm > © respectively, and they cor- 
respond to the fluctuation and drift dominated regimes. The prediction by 
eq. fl53l) is very good even for intermediate Tc ~ in both regimes. In 
contrast, the firing rate for long Tc given in eq. ( H7I) . provides poorer fits 
(dotted line in the left panel) in the subthreshold regime, and even poorer in 
the suprathreshold regime when very large values of a are used (not shown). 
This is because the second prediction of the firing rate was obtained for fixed 
a. 

The figure also shows that the effect of correlations is quite different for 
a neuron receiving subthreshold or suprathreshold inputs. For subthreshold 
inputs, positive correlations always increase the firing rate relative to the 
case without correlations, and the firing rate decreases as the timescale of 
correlations becomes broader. However, for suprathreshold inputs a differ- 
ent qualitative behavior is observed, at least for small white noise variances. 
Positive correlations with long enough give an output firing rate smaller 
than the basal rate without correlations, although this effect is very small 
(notice the large values of a that have been used). A minimum firing rate 
is attained when the correlation timescale is longer than the membrane time 
constant of the neuron, and the exact value of at which the minimum 
occurs is roughly predicted by the analytical formula fl53p . When the white 
noise variances become larger, this counterintuitive effect of correlations dis- 
appears, and the profile is much more similar to the subthreshold case, but 
with much smaller correlation-induced changes. 

Overall, this analysis shows that neurons are more sensitive to correla- 
tions in the subthreshold than in the suprathreshold regime, what is not 
surprising, since in the first re gime spiking is drive i i by input fluctuations 
and correlations enhance them (IMoreno et al.l . l2002l : ISalinas and Sejnowskil . 



20011). 



7.2 Transient firing response 

Another important question is how fast a neuron can respond to pure changes 
in the correlation magnitude a, that is, when both t he afferent mean cur rent 
and white noise variance cx^ are fixed. In our work (IMoreno et al.l . |2002| ) we 
have shown that changes in correlation magnitude can be transmitted very 
fast by the firing rate of spiking neurons even when the timescale of those 
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correlations is quite large. Those firing responses are also compared here 
with the response to sudden jumps in mean input current. 

Let us write the instantaneous firing rate for the time dependent FPE, 
either in the first or in the second representation, as (see eq. fHTl) ) 



n-2 (f) f) /-oo 

i^outit) = J ^dwP{V,w,t)\v=e . (63) 

For the sake of clarity, we have come back to the physical quantity V and used 
its distribution P{V,w,t) {w = z,y). A similar equation for the instanta- 



neous firing rate of a one-dimensional FPE has been used by lSilberberg et al 



( 120041 ) to predict that any instantaneous modification in the white noise vari- 
ance, o"^(t), produces an immediate change in the output firing rate of the 
neuron. Besides, as we have shown before, the exact form of eq. flB^ for 
Tc = corresponds to a neuron receiving (uncorrelated) inp ut white noise 
with effective variance a'^jj- = cr^(l + a), eq. (fTOjl . This gives (IMoreno et al. 



20021) 



i^outit) = -^^tIt / dwP{V,w,t)\v=e . (64) 



2 dV 

Now it is clear that any change in a will produce an immediate change in 
^outit), because the distribution P(V, t) = J dwPiV, w, t) can only experience 
a smooth change (notice that the trajectories generated by the equations for 
V (e.g, see eqs. ([H [221 [23])) are continuous under changes in a). This means 
that when Tc = 0, changes in the correlation magnitude [a) will be felt 
immediately by the firing response of the neuron. By analyticity arguments, 
the response under changes in a will be also fast for non-zero Tc. 

These predictions have been tested with numerical simulations, whose 
results are shown in Fig. Initially the input statistics is white noise, and 
some time later either the mean current /i (bottom curve), or the white noise 
variance (upper curve), or the correlation amplitude a (two intermediate 
curves) are changed independently. Changing abruptly the mean current 
only produces a slow response with a timescale of the order of the membrane 
time constant. However, in the absence of correlations, the firing rate changes 
instantaneously under a sudden modification in the variance of the injected 
current (o"^). In agreement with our prediction, for short Tc the response 
is also very quick when the correlation changes from a = to a positive 
value. To quantify how fast the response is, we computed the time tcross at 
which the instantaneous rate reaches for the first time the value of the final 
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stationary firing rate. The inset in Fig. ([S]) shows that, as a function of 
i cross initially grows but it soon saturates at about 3ms, even when Tc is 
several hundred milliseconds long. Thus, the correlation time is not a limiting 
factor for fast transmission of information contained in correlation changes. 
This result shows that information carried by correlated input patterns can 
be transmitted with a timescale that is not limited by the membrane time 
constant, what is not the ca se for signals embedded i n the mean input current 
( Moreno et al. . 2002 ). In ( Rudolph and Destexhd . 2001 ) the authors show 
that correlation changes can be followed very rapidly by a spiking neuron. 
Because they consider th e case of perfect synchro ny, Tc = 0, their conclusions 
are similar to those by (ISilberberg et al.l . |2004| ). because the case Tc = 
corresponds to a simple renormalization of the current variance (cr^), as we 
have explained before (see eq. (|T9l) ). 

These results show that fast information transmission in cortex using 
spike correlations is theoretically possible. As we have shown, changing 
the mean afferent current produces slow responses if the neuron is in the 
subthreshold regime, because the mean current has to be integrated in a 
timescale Tm- However, because of their fast transmission rate, correlation 
modulations can be an ideal candidate for transmitting information rapidly. 
The fact that changes in /i do not evoke rapid responses does not mean 
that rate codes are inefficient for transmitting information rapidly. Rather, 
changes in the firing rate of "noisy" input spike trains (e.g., as in a Pq isson 
train) involve both changes in and in fiuctuations a^j ( iRicciardil . 119771 ) and 
indeed also in a (see their definitions in eqs. (|T8|) ). Such white noise vari- 
ance and correlation magnitude modulations can be transmitted very fast, 
while the mean current modulations produce a slower response. Therefore, 
an increase in the firing rate of an irregularly spiking presynaptic population 
will produce an output rate change which contains information in at least 
two different timescales (one short and another slow). 



8 Discussion 



In this paper we have provided and thoroughly analyzed a theoretical frame- 
work to understand how temporal correlations affect the output firing re- 
sponse of neurons. The main qualitative results we found are 

• The neuron's output rate is very sensitive to precisely synchronized 
inputs with Tc < Tm- 
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• The response decreases (increases) with the timescale for positive 
(negative) correlations, and increases (decreases) with their magnitude 
a. 

• The neuron response to sudden changes in the size of the correlations 
is very fast, regardless of the magnitude of the change and on the 
correlation time. 

An important question is how our results can be incorporated into the 
modeling of neural networks. Temporal and spatial correlations are presum- 
ably relevant to correctl y describe the dynarn ics of realistic recurrent neuronal 
networks. Recently in (IRenart et al.l . 120071 ) we have proposed an extended 
mean-field approach to determine the firing rate and spiking variability of a 
large network of LIF neurons. In the classical mean-field theory, the neurons 
i n the network ar e assumed to fire in a Pois son and independent manner 
(lAmit and Brunei! . Il997bl : iRenart et al.l . |2003| ) , so that the only free dynam- 
ical parameter in the dynamics of an homogeneous population of neurons is 
its population firing rate. Our extension goes beyond the classical mean field 
theory by adding as a free parameter the spiking variability of the network, 
that is, the coefficient of variation of the inter-spike-intervals, CV . Then, 
the firing rate as well as the variability of the network can be studied with- 
out the assumption that the spike trains are Poisson, corresponding to the 
particular case CV = 1. In particular, stationary states with CV > 1 would 
correspond to states of high spiking variability, while stationary states of the 
network with CV < 1, would correspond to more reg ular spiking regimes of 
the neuronal dynamics. The formalism presented in ( IRenart et al.l . 120071 ) is 
based on the result that when the correlation time of the spike trains is short 
enough ( Tr. -C Tm), the r i the input variability can be expressed as (see eqs. 
mum -. flMoreno et al.l . l2002h ) 



alff = Jl Ne CVl ve + J] Nj CVf , (65) 

assuming that there is no cross-correlations (p = 0). Since the output firing 
rate and the output CV of an integrate -and-fire neurori can be calculated 
exactly when the input is white noise ( Ricciardj . 1977 ). then a mapping 
between the input rates and CV , and the output rates and CV can be 
constructed as 



^out 



fviyini CVir 
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CVr. 



out 



fcvi^in, CVin) 



(66) 



where the functions fu and fcv are the expressions for the output firing rate 
and CV of the IF neuron receiving white noise input. These equations de- 
fine an input-output mapping of the neuronal dynamics with independent 
variables v and CV . Therefore, under the conditions described above, a 
mean-field theory for the dy namics of the rnean a nd variability of the spiking 
response can be formulated. iDoiron et al.l (120061 ) have also recently used our 
renormalization technique of the input variance, as defined in eqs. f l65II^B]l . 
to describe the transmission of the activity o f non-leaky IF neuro n in feed- 
forward networks. As we have said above, (IRenart et al.l . 120071 ) have ad- 



dressed the problem of self-consistency in firing rate and CV in recurrent 
networks of LIF neurons. Other works have also studied this problem using 
different approache s to find self-consisten t equations for the spiking variabil- 
ity of the network (ILerchner et al.l . |2006|) . 



However, further extensions of o ur me an-field theory (IRenart et al.l . 12001 



Moreno et al.l . l2002l : IRenart et al.l . 120071 ) are required to consider in a self 



consistent way the second order statistics of the ne uronal activity in spiking 
recur rent networks. A first step has been made in (IMoreno-Bote and Pargal . 
20061 ). where the auto- and cross- correlation functions of the output response 
of a pair of spiking neurons receiving independent as well as common sources 
of noise have been analytically determinedly. The self-consistent treatment of 
spike cross-correlation functions (i.e., the input and output cross-correlation 
functions should also match each other) to describe more realistic recur- 
rent neuronal networks seems to be an unavoidable step to understand how 
neurons' interactions give rise to network behaviors. The problem can be 
formally stated as follows: find the set of mean-field equations mapping the 
input values of the relevant dynamical variables of the network (firing rate, 
F/v and p) to their output values 



^out fuiyini FN,ini Pin) 

FN,out = fpNi^ini FN,ini Pin) 
pout fpiyini Fj\j^ini pin) ■ 

This set of eq uations are now availabl e at le ast for a LIF neuron receiving 
colored noise (IMoreno-Bote and Pargal . l2006l ) . 



^F or different approximations of this computation see ( Lindner et al. . 2005 : Masudal . 
200i) 
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In this work we have considered decaying (exponential) correlations, while 
i n cortex, damped oscillatory cross- corr e lograms are also observed (see e.g. 



fIVaadia et al.l . Il995l : iRiehle et al.l . 119971 : iFries et all . 119971 )1 This problem 



could be addressed by introducing a stochastic current which obeys a second- 
order equation driven by white noise: the well-known damped oscillator. A 
current generated in this way can have a cross-correlogram with exponentially 
decaying oscillations, with frequency and damping value controlled by the 
parameters of the equation. Although relevant, we do not study this problem 
here, since the new system would involve solving a more complicated FPE 
having now three independent variables. 

Here we have not studied neuron models with conductance-based synapses 
either. However, an analogous expression for the firing rate at long Tc can be 
obtained if the noise enters multiplicatively, instead of additively (although 
we do not present the derivation here, the FPE for neuron models with 
conductance-based synapses can be solved using the techniques in Appendix 
iDl) . Qualitatively, the effect of the correlation magnitude and correlation 
timescale in conductance-based models is not different from their effects in 
current-based models. Note, however, that in the first case correlations are 
strongly effective only when is shorter than the effective membrane time 
const ant of the neuron, which now depends on the total conductance (see 
e.g. ( Moreno-Bote and Parga . 20051 )). 

We have modelled input spike trains as delta functions (point-processes) 
without any further temporal synaptic filtering. This means that the cross- 
correlation function of the total input current displays a delta function at 
zero time lag, as shown in eq. f|T7|l . When the input spike trains are filtered 
by synapses with a finite synaptic time constant r^, they generate a train of 
exponential-like current waveforms into the neuron. The delta function in the 
correlation function, eq. flTTl) . becomes then an exponent ial with the same 
time constant as that of the synapti c filter, Ts (see e.g. (IBrunel and Sergil . 
19981 : iMoreno-Bote and Pargal . hooi )). At the same time, the exponential 



term in the correlation function results after filtering in two additional ex- 
ponentials, with time constants Tc and r^, respectively. Then, the result of 
(linearly) filtering correlated input spike trains is an input current whose 
correlation function has two kind of exponentials, each with a different time 
constant (tc and r^). Particular cases of this interesting problem (e.g. when 
the two timescales are disparate) could be addressed analytically by using the 
techniques developed to study simultaneous fast and slow synaptic filtering 
( IMoreno-Bote and Pargal . 120041 ). 
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Two differences are expected when synaptic filters are present in the 
model. First, synapses filter out fluctuations in the input whose timescale is 
shorter than Tg and convert them into fluctuations with timescale Tg. Fluctu- 
ations that are slower than Tg will pass the synapses. Therefore, fast fluctua- 
tions produced by precise input synchronization (i.e., short Tc < r^) will not 
be seen by the neuron: effectively the sharp synchronization of timescale Tc is 
converted into a coarser synchronization with timescale Tg. Then, we expect 
that for Tc < Tg the firing rate will depend very little on Tc in that range. 
However, when > Tg the rate vs. curve will decay fast until crosses r^, 
after which the effect of input correlation on the rate will be small, similarly 
to Fig. Second, filters introduce a delay in the transient firing response 
to sudden increases of input synchrony. We have run simulations with fast 
filters {Tg < 5ms) and found that the response was still fast and was delayed 
by the time constant of the synapses. 

In future work it would be desirable to develop a complete theory that 
describes the firing statistics of integrate-and-fire neurons with conductance- 
based synapses and finite synaptic timescales driven by correlated spike 
trains. The effect of input correlations in this more complex system could be 
evaluated by extending and combining the techniques developed in this and 
the above quoted works. 
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Appendices 

A Numerical procedures 

The equations for the voltage of the integrate-and-fire neuron and the cor- 
related Gaussian noise are numerical solved using a simple Euler integration 
procedure, along with a Monte-Carlo method. This procedure gives an excel- 
lent estimate of the the output firing rate (time dependent or independent), 
which can be compared to the theoretical predictions. As an example, the dy- 
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namics of the voltage of a LIF neuron in eq. ([T]) with the current I{t) defined 
in eqs. is integrated using a small time step {6t = 5 10~^ms -C r^) 

as 




V{t + 6t) = V{t) ^-^6t + I{t)6t , 



(67) 



(68) 



(69) 



with the reset condition V = H after a spike is generated (when V > Q). 
The initial value of the noise variable z is that at the time of the previous 
spike, i.e, z is not reset after each spike. The variable uj{t) is a random 
variable taken values +1 and —1 with equal probability 1/2 at each time step 
5t, and being drawn independently from time step to time step. Therefore 
{uj{t)) = 0, {uj^it)) = 1 and (cj(t)cj(t')) = 0, where t ^ t'. This means 
that the quantity uj{t)/\/&t, which appears in the expression for the current 
I{t) above, is an approximation to the delta function, since (uj{t)/\/St^ = 0, 
{uj'^it) / 5t) = l/6t, and {uj(t)uj(t')/6t) = 0. The procedure described above 
is robust and converges to the true stationary process as 6t decreases. The 
Monte-Carlo simulations were run using Fortran90 custom code. Special care 
has to be taken in choosing an appropriate random generator for ui{t). 

B Derivation of the FPEs 

The FPE fl28|) is here derived for the set of equations 



corresponding to the first representation of the current. The FPE (1341) as- 
sociated to the second representation of the current can be obtained using 




(70) 
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the same rules describ ed in this section. More forma l derivations of similar 
FPEs can be found in ( iRicciardil . 119771 : iRiskenl . Il989l ). 

The system defined by eqs. ( ITOl) is fully described by the probability 
density function Pp{x,z,t). This function expresses the probability density 
of having the neuron in the state (x, z) at time t. The FPE is an equation 
with precisely describes the dynamics (i.e., time evolution) of such a density. 
A first step toward the derivation of the FPE consists in discretizing the time 
in the dynamics, similarly as it has been done in Appendix |Al This leads to 



x{t + 5t) = x{t) - ^^6t + J—uj{t)\f&t + —i=z{t)6t 



z 




z{t + 6t) = z{t) 6t+ J-uj{t)V6t , (71) 



where 6t represents an infinitesimal time increment, and uj{t) is a random 
variable taken values +1 and —1 with probability p{w = ±1) = 1/2 and 
drawn independently at every infinitesimal time step. The terms in eqs. (1711) 
proportional to ^/di are approximations to the delta functions in eqs. ( ITOil 
integrated during the infinitesimal time increment. 

To determine the FPE associated to eqs. (!70|) . one has to relate the 
density at time t + 6t, Pf^i^x, z,t + 6t), with the density at a previous time t, 
Pl3{x', z',t). First, we realize that the probability that we find a neuron in 
an infinitesimal square 6x'6z' around state (x', z') at time t has probability 
P/3{x' , z' ,t)6x'6z' . Second, the state square centered at {x',z') with surface 
6x'6z' will be projected at the successive time t + 6t into another square 
centered at (x, z) with surface 6x6z close to the previous one, obeying the 
rules defined in eqs. ( 1711) . Therefore, by conservation of the probability, we 
have that 



where 



Ppi^x, z,t + 6t) 6x6z = ^ p{w) Pp{x'{w),z'{w),t) 6x'6z' , (72) 

w=±l 



X [2 ^ (3 
x'iw) = X ^ 5t — \ — ujy5t z5t 




42 



Notice that the states {x'{w), z'{w)) {w = ±1) defined above are the only ones 
from where one can arrive to the state (x, z) after an infinitesimal amount of 
time 6t. In addition, the box around state (x', z') is compressed to the box 
around the final state (x, z) by a factor 6x6y = (1 — 6t/Tm){l — 6t/Tc)6x'6y', 
given by the decaying term in eqs. flTOj) . 

After expanding the densities in eq. ( 1721) in powers of V&t, we find that 
all terms which are order \/&t are equal to zero (since (uj) = 0), while the 
terms order 6t do not vanish (either they do not depend on u, or they are 
proportional to cu^, and therefore {u"^) = 1). After equaling the terms at 
0{St), one obtains the FPE 

d ^ , ^ Lz 2 d , d , , , ^ 

r„^P,(x. = |i. + ^ + - y)lP,(x. . (73) 

In the time-independent case, ■^Pp{x, z,t) = 0. However, to establish a 
stationary probability density function which does not depend on time, the 
probability density fiux escaping at threshold (probability density flux in the 
direction of the variable x calculated at threshold) should be reinjected into 
the reset voltage. This enforces conservation of the total probability, that is, 
/ / dxdzp{x, z,t) = 1 at all times, and leads to the self-consistent stationary 
FPE ([28D. 

C Long Tc expansion using the first represen- 
tation 

Here we detail the main steps for calculating the firing rate in eq. fl47p . 
Introducing the expansions fH3| H4l) in eq. fl28|) we obtain 

d d dz 

L^hn + Lzhn-2 + 2^(^ - ^)hn^i + rm5{x - v^i/) J^,„„i (2;) = (74) 

[hn = for n < 0). The solution to these equations is obtained order by 
order in such a manner that the conditions (138) - |4T!) are satisfied. After 
solving them up to order k"^ using the conditions (15^ and the fact that 
the hn^ have to be normalizable, we obtain that 

ho{x,z) = ko{x)Jf3^o{z) , 



43 



d 

hi{x, z) = ko{x)Jf3,i{z) + ki{x){2— - Pz)Jpfi{z) 

d 

h2{x, z) = ko{x)J(3^2{z) + ki{x){2— - (3z)Jp^i{z) 
+k2{x){2-^-(3zyjf,,o{z) , 



where the functions ki are 



(75) 



ko{x) 
ki{x) 
k2{x) 



e 2 



e 2 



I 



e"- / dye^H{y-V2H) 

J X 

dye 2 /co(l/) , 



dye 2 fci(y) 



The coefficients Ji^piz) in eq. (175!) have still to be calculated. This is done 
by integrating ffist the /i„'s over x from —oo to ^/2Q and using the condition 
After using the condition (jlU]) . we find 



^o(^) 
Mz) 

Uz) 



^oZo{z) , 

(2 + /?)z/o/.^QrfxA;i(x) 
I^^dxkoix) 



a 



C + 



aC 



z Zo{z) , 
z'^-l) 



ZJz) 



U^^dxk,{x)f 
J^dxkoix) 



V20 



dxk^ix) 



(76) 



where Zq[z) = e~^^/^/v^27r. Finally, integrating again Ji,^{z) over z gives the 
contributions to the output ffiing rate in eq. ( H71) . In the next section we 
calculate the integrals appearing in the parameter C in eq. ( 1761) . 

C.l Integrals 

Here we only present some intermediate steps and the final results for the 
integrals appearing in C, eq. (1761) . The last two integrals can be expressed 
in terms of the function R{t) = 



f e*'(l + erf (t)) = e*' ds e'^'/^ 
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V2e 

dxkQ^x) 



OO 



Tm I ~ dxe / " dye^2 H{y - V2H) = 



2. / dxki{x) = / dxe~~ / dye~ko{x) = 

J —OO J — oo Jx 

rV2e y2 j.y 

Tm ^ dye^ dxe 2 [y - x) = T.m{R{Q) - R{H)) . 

JV2H J-00 

3. / dxk2{x) = / —dye 2 / dxe~ ^ {y — x) = 

J-00 JV2H 2 J-00 

D Long Tc expansion using the second repre- 
sentation 

In this section we derive the output firing rate formula ( l53i) using the FPE 
(!34|) . Here, we take the ratio 7 = ^Jajk to be a parameter independent of 
fc, that is, it is fixed. This will allow us to study the case of large a in the 
long Tc limit. From the FPE (13411491) we develop a systematic expansion of 
the probability distribution Pa{x,y) and the escape probabihty density flux 
Ja{y) in powers of k~^ (see the expansion in (1501) ). in which 7 is considered 
a fixed parameter independent of k. Inserting the expansion in eq. (13U]) into 
the FPE (glD produces 



d 

[L^-'yy—]rn + Lyrn-i + TmS{x-V2H)Ja,n{y) = , (77) 

where r„ = if n < 0. For simplicity, the set of conditions ([38]-|l2]) is used 
here when Tref = 0. Solving the zero-th order in eq. (1771) with conditions 
(1391 ED gives 



(x-jy)'^ /■V29 (u-7y)2 _ ^ 

ra,o{^,y) = r^Jafiiy) ' / due ^ H{u-V2H), (78) 

Jx 
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where the escape probabihty density flux Ja,o{y) has yet to be determined. 
This is done by using the condition with r^ef = at zero-th order, to 
obtain 



Ja,o{y) 



1 



2tit„ 



V2e-'ry ^ 
due 2 

V2H-yy 



dve 2 



(79) 



Repeating the same steps as above, the n—th {n > 0) order escape probabihty 
density flux is found to be 



J, 



v^e 



due 2 



dve~ 



dxe 



-(x-iy) 



V2e («-7y) 

dve 2 



2 pu 

y 



dvrn{v,y) 



(80) 



and the density is computed as 



rn{x,z) = e 2 / dve 2 Ly dvrn-i{v,y) 

Jx J — oo 

+rmJa,n{y) 6 2/ du e 2 H{u - V2H) . 

The zero-th order rate is obtained by integrating over y the zero-th order 
escape probability density flux in eq. ( 1791) This gives the firing rate in eq. 
( 153|) . For fixed a, the parameter 7 decreases as Tc grows. In this limit, we 
could expand the zero-th order firing rate in powers of 7. The firing rate 
obtained from this expansion has a dominant order (0(7^)). However, 
other contributions to the total firing rate at order k~'^ could also come from 
the non zero-th order firing rate from the expansion (ISO]) . In particular, the 
first order {n = 1) rate in the expansion fl50p is order k^"^. However, it is 
possible to see that an expansion in powers of 7 in the term with n = 1 in eq. 
f lHOj) also leads to an extra dominant order that multiplied by k^"^ yields 
finally a correction to the firing rate bigger than 0{k~'^). This finally proves 
that the leading correction to the firing rate for fixed a when Tc approaches 
infinity is order k~'^ and it is given by the expansion of the zero-th order rate 
( 153|) . Naturally, this expansion matches the output firing rate formula (HTll 
for positive correlation magnitudes. 
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E Short Tc expansion using the second repre- 
sentation 

E.l The Free Solution 

We introduce an expansion of the form (l55l [56]) into the FPE (!34l) and find 
the set of equations: 

Lyh = , (81) 

Lyh = V^yfo , (82) 

Lyf2 = -L^fo + Vayfi - r,^5{x - V2H)ueffZo{y) , (83) 

Lyfs = -LJ^ + ^yh - r,J{x - V2H)u^Z^{y) , (84) 



where 2'o(j/) = e ^ /^/v^27r. After solving eq. flHTl) we find that the only 
normalizable solution is 

h{.x,y) = go{x)ZQ{y) , (85) 

where go has yet to be determined. The equation at order k gives the ex- 
pression for /i 

d 

fi{x,y) = [gi{x) - y/ay—go{x)]Zo{y) . (86) 
Again, gi is unknown. The equation at second order satisfies 



Lyf2{x,y) = -aygi{x)Zo{y) 

-[Lx9o{x) + a—go{x) - Tm6{x - V2H)ueff]Zo{y) . (87) 

Using that the integral / dyLyf2{x,y) has to equal zero in order for f2 to be 
integrable, we can integrate eq. ( !87l) over y and obtain the condition 

[—X + (1 + a)—]goix) + T^u,ff5{x - V2H) = . (88) 

This equation is the same as that o btained when so lving the FPE for a LIF 
neuron driven by white noise input (iRicciardil . 119771 ) . but where the variance 
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of the noise has been renormahzed by a factor l + a. This equation is solved 
exactly for all a using the condition fl39l) : 



gJx) = ^^^ -WT^ / dye^(^H(y - V2H) . (89) 
l + a Jx 

The firing rate Veff (the zero-th order in the expansion in powers of k) is 
obtained by applying the condition (|38l) to /o in eq. (l85ll . 

Similarly, while solving eq. fl8^ a condition over gi is obtained, from 
where gi is determined, except for an unknown constant D: 



gi{x) = De~^(^ + -^!^e~^(^ / dye^(^H{y - V2H) . (90) 
l + a Jx 

The constant D is needed to match the boundary condition at threshold (!39|l . 

Now it is crucial to realize that the first order solution fi does not satisfy 
the boundary condition at threshold (|39l) for any value of D. Thus, we have 
to add a boundary solution so that the total solution (l57j) satisfies it up 
to order k. This boundary solution, found in the next section, serves to fix 
the value for D as 

D = au,ffT^e^. (91) 

Using the normalization condition fl38|) on the term order k in the expansion 
of Paix, y), eq. flS7|) leads to the firing rate at order k in eq. fl55]) 0. In that 
equation we have approximated Ueff by z/q and also all a appearing in eq. 
(pOj) have been made equal to zero. These two approximations are justified 
because expanding u^ff and eq. (!90!) in powers of a gives corrections to the 
firing rate at order k that are higher than 0(a). 



E.2 The Boundary Solution 

Here we find the boundary solution, f^, for the FPE (IMI) valid close to 
threshold and for small k. The FPE in this limit takes the form 



^ d 
\/ay— + — 
or oy^ 



y^ + Oik,e) 



u{r,y) = . 



(92) 



^Notice below that J J u{r, z) = 0{k), and for this reason we can neglect its contribu- 
tion to the rate at order k. 
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We have replaced fi{x, y) = u{r, y)ZQ{y) and we have made the hnear trans- 
formation r = {x — ^/2Q)/k. A complete basis for this linear differential oper- 
ator is not known, but if ^/a = a complete basis for an integrable function 
of r G [— oo,0],y G [—00,00] is given by the set of functions e^^Hn{y/V2) 
for all n > 0, where if„ are the Hermite polynomials If]. We insert into eq. 
( 192|) a solution u of the form u = uq + ^Jolu\ + au2 + 0(a^/^) to obtain 



Q^2 Qy2 



d_ 

^ dy 



Ui+i{r,y) = y-^Ui{r,y) . 



(94) 



The solution has to be added to the perturbative solution /i, eq fl86l) . to 
match the boundary condition fl5^ . that is 



De 



Vay-K-9o\ 

ox 



=726 = • 



(95) 



Defining d = De~^ and expanding it in powers of y/a as d = dQ + y/adi + 
ad2 + 0{a^^'^), as well as the others terms in eq. (!95|) . we obtain the set of 
conditions 



do + Uo{0,y) = , 

di + feffTmy + ^il(0, y) = , 
C?2 + M2(0,2/) = . 

Now we express each order Ui as a linear combination of the functions e^^^'Hn{y/ v^) 
plus a particular solution as Ui{r,y) = J^T ^n,ie^'' Hn{y / V^) + Ui^part{r,y). 
We find 



Uq = , do = 

Ul = -VeffTmye'' , C^i = 



^The Hcrniite polynomials satisfy the equation 

The first three polynomials Ho{y) = 1, Hi{y) = 2y and i?2(y) = — 2 are used in our 
calculations. 
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With these solutions, we finally found the value of D up to order a, eq. (PT]) . 



F Short Tc limit for a generic IF neuron. 

In this section we extend the formalism described in Appendix [E] to calculate 
the firing rate of a generic IF neuro n receiving a Gaus s ian ex ponentially 
correlated input in the short Tc limit (IMoreno and Pargal . |2002| ) . A generic 
IF neuron can be defined by the leak function, f{V), that determines how the 
voltage behaves in absence of any input. In this model, the depolarization 
membrane potential V{t) evolves from the reset voltage H according to the 
stochastic equation 



V{t) = -f{V)+I{t), (96) 
where I{t) is the synaptic current with exponentially temporal correlations 



as in eq. (fT7|l . When the Gaussian current is expressed using the second 
representation, as it is defined in Section fl4.2p . the FPE associated to this 
model neuron is 



d (j^ d 1 d d 



l2ala d 

Tr. dV 



P = -5{V-H)J{y) 
(97) 



Using the same procedure as in Appendix [El we find that the output firing 
rate of such a generic neuron is 



where 



(98) 



V, 



eff 



Tref + 



^1 



V2, 



a^jf JH 



a,. 



e 



ave ^ff 



dve 



(99) 



which is valid whenever the above integrals are defined. This geiieral f ormula, 
that has been previously found in our work (IMoreno and Pargal . 120021 ). shows 
that the ^JTc decay of the firing rate is universal for IF models with hard 
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threshold. Using this general formula it is possible to obtain the firing rate 
in the short limit given by eq. (ISSj) for a LIF neuron. 

Using a different procedure we have been able to calculate exactly the 
firing rate of a non-leaky IF neuron {f{V) = 0) with exponential correlations 
without the need of the boundary solution to fit the boundary condition at 
threshold. This formula is valid for all Tc and for small a. We still require 
the condition Tc -C r^e/. This exact formula, however, allows us to check the 
technical procedure described above, and it naturally gives the same result. 
This firing rate is expressed as 

i^out = veff - °^ i + 0{a') (100) 



where 7 = A = \h'^ ^ — r— and Ueff is defined below, eq.f llOip . An 
expansion of eq. fllOOl) for small Tc leads to the same universal ^Jt^ decay 
law, and the coefficients are identical to those produced by eqs. fl99|l : 



_i Q-H 
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Cross-correlation 




Figure 1: 



Caption 1: Illustration of the problem studied in this paper (a fully 
detailed description is given in the text). A set of afferent presynaptic 
spike trains impinges on a LIF neuron. Each individual spike train has 
exponentially-shaped auto-correlations, describing the joint probability den- 
sity of having two spikes separated by a particular time lag (a delta function 
should be included at zero time lag because the train is made of point events; 
see text). A fraction of the trains also have exponential cross-correlations, 
describing non-independent firing of some of the presynaptic neurons. The 
total current generated by the presynaptic bombardment is replaced by a 
Gaussian process with the same mean and two-point correlation function 
than that generated by the superposition of all presynaptic spike trains. The 
goal is to characterize the spiking response properties of the LIF neuron as 
a function of the global magnitude and timescale of the input correlations. 
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Figure 7: 
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Figure 8: 



57 



Caption 2: (A): An individual afferent spike train from population p could 
show correlations between two times, t and t': the probability of finding a 
spike at one of those times depends on the existence of a spike at the other 
time. (B): This temporal correlation is described by the auto-correlation 
function, Cp{t — t'), assumed to have an exponential shape. The firing rate. 
Up, Fano factor, Fp, and correlation time, Tc, enters in the definition of the 
shape and size of the exponential as described in the plot. The delta function 
present at zero time is proportional to Up, and participates in the total area 
of the autocorrelogram. (C): When the spike count of the spike train is 
integrated over a time window T, the variance of the count divided by T goes 
exponentially from Up to F^^pVp. For small time windows, the count variance 
converges to that of a Poisson spike train, which is equal to VpT. However, 
for longer time windows than the correlation time Tc, the count variance 
scales as FM,pVp, indicating that then the effect of temporal correlations is 
fully visible. 
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Caption 3: (A): The probability of having a spike at time t in an afferent 
spike train belonging to population p could depend on the existence of having 
a spike at time t' on other spike train from population q. (B). This correlation 
is described by the cross-correlation function, Cpq{t — t'), assumed to have 
exponential shape. The firing rates, Fano factors, correlation coefficient of 
the spike counts, ppq, and correlation time, Tc, determine the shape of the 
exponential, as illustrated in the figure. (C): When the spike counts of the 
spike trains in the top panel are integrated over a time window T, their 
covariance divided by T increases exponentially from zero to a finite value 
proportional to the correlation coefficient (here we define N'{T) = N{T) — 
{N{T))). For short time windows, the covariance is zero and therefore it 
resembles that of two independent spike trains. However, for time windows 
longer than Tc, correlations are fully visible and the covariance is non-zero. 
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Caption 4: Diagram of correlations in excitatory (E) and inhibitory (/) 
neuronal populations presynaptic to the same target neuron. The presynaptic 
E and / populations make Ne and Nj contacts respectively with the target 
neuron. A fraction fEE(ii) of these Ne{i) excitatory (inhibitory) neurons are 
correlated with each other with a correlation coefficient Pee{ii)- Also there 
are E—I correlations, with a fraction Jei participating from the E population 
and a fraction fjE from the / population, for which the correlation coefficient 
is Pei (= Pie)- Since all E neurons in the fraction fEi are correlated with 
any given / neuron in the fraction fjE, these E neurons necessarily have 
E — E correlations. Therefore, they are considered here to be a group within 
the fraction Jee, as shown in the figure. The same applies for the / neurons. 
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Caption 5: Normalized correlation functions of the current I{t) numer- 
ically generated by simulating the process defined in eqs. - [251) . The 
normalized correlation function of the current is defined as Ccurrent{s) = 
Ccurrent{,s) / — where Ccurrent{,s) is defined in eq. fl26l) . The variable s 
is the time lag s = t — t'. With this normalization, the correlation function 
has units of Hz. For positive correlations (left) we took /3 = 2, which yields 
a correlation magnitude a = 8; Tc = 15ms. For negative correlations (right) 
we took P = —0.5, which corresponds to a = —0.75; here Tc = 5ms. In 
both cases, numerical results are compared with the exponential functions 
predicted by eq. (!26l) (non-fiuctuating curves). 
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Caption 6: Theoretical predictions (lines) and simulation results (points) 
for the output firing rate of a LIF neuron driven by exponentially correlated 
inputs as a function of the correlation timescale. Here we use eq. fl6T|) for 
short Tc and eq. fl62|) for long Tc, along with a continuous and smooth inter- 
polation between the two limits (the interpolation is made at an intermediate 
Tc,inter ~ Tm)- The rate decreases when the input correlations are positive 
{a > 0, upper curve) and increases when correlations are negative (a < 0, 
lower curve). When there are no correlations (a = 0), the neuron fires at a 
rate of lOHz (dashed-dotted line). Maximum rate differences relative to the 
rate with no input correlations are attained when = 0, that is, when the 
input correlation is exquisitely precise. Differences are substantial whenever 
the correlation time is shorter than the membrane time constant of the neu- 
ron [Tm = 20ms for this case; shaded region). When the correlation time 
becomes longer than r^, relative changes are much smaller, and the neuron 
becomes less sensitive to the input correlations. Correlation magnitudes are 
a = 8 (upper curve) and a = —0.75 (lower curve), and interpolations be- 
tween the short and long Tc theoretical predictions were performed at the 
interpolating time Tc^mter = 40ms and 20ms respectively. Other parameters 
are r^ef = 0ms, 6 = 1 (in arbitrary units), H = 0, fi = 42s~^, = 2s~^. 
Although the short Tc expansion requires r^e/ 7^ the simulation shows that 
this prediction is good even for zero Tref- 
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Caption 7: Theoretical predictions and simulation results for the firing 
rate of a LIF neuron as function of the correlation timescale for the sub- (left) 
and the suprathreshold regimes (right). Here we use eqs. fl47ll53p . valid for 
long Tc. For the subthreshold regime, the effect of increasing the correlation 
time is always to decrease the rate. However, for the suprathreshold regime 
and when the input noise is small, the effect is the opposite for long Tc. As the 
input noise increases, this effect disappears and the curve becomes as in the 
subthreshold regime (data not shown). The theoretical predictions (full lines) 
are obtained using the firing rate given in eq. (153|) without any interpolation, 
and the discrete points are the simulation results with the same parameters 
as in the theoretical curves. Parameters for the subthreshold regime are: 
fj, = OHz, 0"^ = 50.5Hz, and a = 4 (top full line and squares), a = 1 
(bottom full line and circles) and a = (straight line). The dotted line has 
the same parameters as the top full line, but it has been obtained from the 
expression of the rate in eq. (jTTl) . Notice that the prediction from eq. (|53|) . 
strictly only valid for long Tc, is also good even when Tc ~ r^, and it is better 
than that provided by eq. fH7|) for all r^. Parameters for the suprathreshold 
regime are: /i = 100.7Hz, = 0.05Hz, and a very large correlation strength 
a = 36 (bottom line and triangles), a moderate correlation strength a = 
9 (intermediate line and diamonds) and a = (straight line). The other 
parameters are as in Fig. ([6]), except for = 10ms. 
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Caption 8: Averaged transient firing responses of a LIF neuron to changes 
in tlie input statistics. Below t = the input is wliite noise {a = 0) witli 
II — 16s~^ and cr^ = 0.81s~^. Upper curve: instantaneous response when 
(7^ is increased up to cr^ = 3.8s~^. Second (third) curve: quick response to 
correlation changes, with Tc = 5ms (100ms) and a = 6.8 (52.3). Bottom 
curve: slow response when fi is changed from /i = 16s~^to fi = 19.9s~^ and 
cr^ is kept constant. These values were chosen so that the evoked firing rates 
in the final steady state are roughly the same (~ SHz, straight hne). Inset: 
time when the firing rate response reaches for the first time the value of the 
final stationary rate as a function of Tg. When the correlation timescale is 
very short, tcross is very small, and it saturates for long r^. Neuron parameters 
are = 50ms, r^e/ = ,0 = 1 and H = (dimensionless). 
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